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ABSTRACT 

\ Although research on testwiseness has varied to a 

great extfent in the aspects of testwiseness measured 'arid the 
strategies used/ some conclusions can nevertheless be -drawn: 
testwiseness is a bona fide entity and deserves attention^ it is 
measurable, it appears to be made up of- h set of specific skills 
* rather 'than a collection of some general holistic abilities, and, 
training in testwiseness can be administered to students of all ages* 
from early childhood to adulthood. Working oh the assumption that 
teachers at all 'levels need to be made awaxfe of testwiseness 
strategies and bo. able to t^ain their students in acquiring these ' 
skills, a study examined whether some training of undergraduate 6 * 
student -teachers* to tea^h"* testwiseness* strategies would result in a. 
signif icant degree of draSEerence. between the criterion referenced 
content area test& scores of elementary school children taught these 
strategies and the* test scores of children not taught the strategies. 
Eight student teachers and 174 elementary schpol sttfdents^^^ 
participated in the study. Each day for 3 weeks students in the 
experimental groups feceived testwiseness activit'ires While the 
students in the contrbl groups/ worked orf'other activi t i'es such* as art 
or\library work. Results "indicated that although there was not a 
significant difference between the experimental aftd control treatment 
groups /for any of the units taught and for* any of the grades or 
ability groups, there was a slightly higher observed score >f or six of 
the nijne experimental groups. This does- not indicate that the student 
teachers were able to transfer the testwiseness strategies, / 
instruction they recerved to* the studen-fcs they taught. (HOb 4 ) * 
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• • - -SHOULD TESTWISENESS CURRICULUM 

••pppM,™ TrtM '• BE A PART-8F UNDERGRADUATE TEACHER EDUCATION? . . »- 

PERMISSION TO REPRODUCE THIS • . • 

MATERIAL HAS BEEN GRANTED BY • ' ' ' U.S DEPARTMENT OF EDUCATION 

Rona F. ninpn Rp™ F. Flippo, BKD. — n 

' Paul Rnnt-h.n^ Georgia Department of Education center.^, 

r^Jl dOrtnWJCK . , * ^ ,/ ThtS doCume ni has been reproduced as 

[ ~ , 'received from the person or organ.zat.on 

' . % * Paul Borthwick, Ph.D, * ' originating it 

TO THE EDUCATIONAL RESOURCES Delta State UniVerSitV % Mmor changes have been made to ."prove 

INFORMATION CENTER (ERIC)." • ' J * ' . ^ptoducwn qugr _ 

, ' . p 0l nts of view or options stated m this docu 

; 1 me nt do»not necessarily represent otf«ca. N1E 

position or policy . ^ 

T^e idea of teaching testwiseness 5 to scHbbl -aged students and post- 
secondary students is certainly not innovative or* -earths ha king, * Interest 
in this area has gained momentum over the*last few years. In most 
situations the subjects of this interest have been the students. We are * . 
seeing more books and more chapters within reading and study skills books 

that have been written to teach, students testwiseness strategies. • % 

* ■ " ' . . - # < . \ ' ' • • * 

Although some material, has been directed toward the elementary child, 

more* efforts have centere<j*on the high school arid (poll ege* student. 

While we concur with these efforts and realize the neecl for good 

' testwiseness books for students, we also see another need. Perhaps some' 

.effort should be made in undergraduate teacher education? If prospective 

teachers tgok testwiseness as part of their undergraduate curriculum, perhaps 

they could successfully transpose some of these testwiseness strategies to 

• the students they will teach? We feel that this undergraduate training ' 

should be explored for elementary majors as well as for the secondary fnajors. 

Perhaps sortie early testwiseness* training in the elementary grades across 

the disciplines would cut down on sonk of the potential test-taking problems 

in secondary schoolPand colleges?,. We know thatjnany education programs 

include a, class in testing and measurement. 'Perhaps testwiseness strategies 

\ * • * * 

. curriculum could be a unit of such a- class? 
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What is Testw iseness? 
• : ^ 



/ The term "testwiseness" (TW) .has meant many things" to many people* 
A variety of interpretations and definitions has been associated with it. 
The following definition of testwiseness by Millman, Bishop, and Ebel (1965) 
will be used for purposes of this, paper: \ v - 

"A "subject's capacity to utilize the characteristics 
. • * - a " d formats a£ the test and/or the test' -taking, situation 

to -recei^ a ^.high score.'" 11 '(p. 707) • 1 ' ■ • 

This^definitioK^niphies tba^'TW^s independent from the" test-takers'/ 
.knowledge of the..conteri£ contained' oil She telt 'itself.. An immediatejquestiph 
, -tha-t comes' tp mi hcL would be, whether or not one's mental - Or general ability 
.h(asj-a Tela'tionshipVwith-TW. . A , review of the literature -reveals ttiat .numerous.' 
"studies have "investigated 1 this, question.- '-*'..• 

.Diamond and. Evarrs (1972) studied 'tffe. TW of selected sixth grade students 
and reported that no ..relationship exists between TWand general skill pr 
ability. However, they did conclude that TW was unique 'to 'the cues or clues' * 
under study. This conclusion had also. been previously substantiated by 
Dunn and Goldstein (1959) 'who found' no relationship between TW and intelligence. 
In a VeTated. study,' Ayrer,- Diamond, ETshman and Green (1976) did not 

0 ► J. * , 

find any relationship existing between TW and increased scores on the • 
California Achievement Test among inner city students. For the-most part, 
all correlates were low. Thusr'this study does not* support the Diamond 

"and* Evans research statement that "TW as a secondary cue response' is quite 
specific to the particular clue or cue under instigation. " . . . * 

The question as to'whether TW ability of students changes as they 

-'progress through, v the grades was investigated by. Crehan (1977). This 
longitudinal* study indicated that TW apparently is rather, stable but increases. 



somewhat- up through "the grades. These 'investigators also noted a lack 

0 » * 

"of evidence supporting a relationship between TW and the sex of .the- students. 

Testwissness Strategies ' 
When discussing TW, many .references are made to the categorization « 
6f TW strategies as developed by Mill man, 'Bishop and Ebel (1965)- In < 
their paper, two categories are presented: elements that ar,e independent " 
of^the test corrstnlictoy: or test purpose* and- those that, are dependent u[)6n 4 
the"" constructor or purpose v The .first category, often called general test-* 

taking strategies contains strategies/for util izing/time efficiently, 

• * * :\ ■ * ' ' - ' \ " * 
proofreading answers in order to avoid ^rrors, learning how and when /to 

make appropriate guesses, and 'using deductive reasoning in-order, to arrive 

■s . / • » ' ■ 

at a correct answer. Included in the second category are strategies" designed 
to consider the intent of the test constructor for using certain questions 
and for. u'sinq cues found in the # test wh^n the answer is- uncertain. 

Four basic TW strategies were' developed by Crehan .(1977), Two of 

/ * * r • « 

these strategies involve deductive reasoning and the other two strategies 

involve usijig cues in. order to arrive at an appropriate answer. 

Gibb (1964) developed' a strategy concerned with the problem of cues • 
* | * * 

in test items an<5 identified TW as a secondary cue response. His major; 

pfemise was tha£ students can be trained/in TW and thjeir perfonpance would 

not be* determined by knowledge Qf % the subject matter.^ 



\ -4- 
* * * 

The study by Diamond ^and Evans (.1^72) used fictitious material ^o 

eliminate content familiarity with naive sixth grade students, and ' ' 

investigated the correlates of TW: Diam5>ri%and Evans 1 strategy included 

the following five item faults selected for the study: association, 

, -specific determiners', correct alternatives, grammatical clues and over- 

m m . lapping distractors. Wtth TW 'defined as a secondary cue response*, the / 

\ 9 -naive students appeared to have. possessed "if. However, data revealed 

that TW is not a general trait, but specific to the particular glue or cue 

be tng" investigated. Therefore, the results were supportive of those* of * 

< both Gibb (1964) and Dunn and Go1dstein->(l 959) . , 1 

The research, has revealed "that TW is not a pervasive ski 1*1 1 ^ince ' 

consistent individual differences are found in' response to a*specific form 

of strategy clue (i.e., grammatical .clues) and that these .responses do not 

relate to one's general mental ability. * . 
■ * . 

■ ■ Testwiseness Training a 

The practice of TW training has been widely investigated ^ith the^ 
effects resulting in varying degj^s of success. Giving emphasis on 

characteristics and format of the test rather than upon content or coaching 

/ * /" 

for/a specific exam, Wahlstrom and *Boersma (1968) concluded that ninth 

frade students receiving TW training had higher scores on criterion referenced 

tests. Oakland (1 972) showed that disadvantaged preschool students having 



had TW training obtained a higher mean on the Metropolitan Reading Readiness. 
Test than those in the'control group, fjowever, when measured four months 
.later^, the- results, were not significantly different. ' 

"Callenbach's (1971) investigation reported that test-naive second 
graders who received TW 'training scored -significantly higher <3f\ both an 
immediate and" delayed standardized reading posttest than those students. 

*who received no training. . . , j * 

* • - ■ I 



Not all researchers, however, found TW training to have' positive 
effects. As' cited earlier, Diamond et a>.. (1976) found no substantial 
relationship between the scores on the Vocabulary, Reading Comprehension 
or Language, Usage subparts of the California Achievement Test of students 
. given TW training and the control group. Yearby (1975) found that the . 
TW skills of some third grade students were significantly increased by 
'training but tha't this did ftot transfer to a significant degree on a . 
standardized^' reading test. -Jn addition, -although Jongsma and Warshauer (l 975) 

report 'that fifth grade inner city students who had- studied 'a unit on TW 

r. , ' *) 

skills averaged higher reading achievement scores than a contrql group, 
. J:heir gains were not significant. 

Although research on TW has varied to a great extent in thte aspects- 
of measuring TW and the strategies used* some conclusions can nevertheless , 
be drawn.. First, TW is a bona fide entity and deservts attention. Second, 
TW is measurable. Third, TW appears to be made up of a set of specific 
skills rather than a collection of some general or wholistic abilities^ • 
and, fourth, -TW traTnTng^ be administered to students of all ages from, 
ear>5y/ childhood adulthood. * 

' / " * * 1 « 
<j It would, *therefc>rt,* seem that teachers at*all levels need to be made. 

aware of TW strategies and be*able to* train their students in acquiring 

these skills." This awarenes^-eet/ld take place in teacher education- 

programs, where 'presefvice teachers. could be trained to teach TW. skills * 

to their future students/, * ' 0 » * < 
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, ' ' / ' • y . ' . . - P'ilot Study 

Since. we believe that some emphasis on { the teacher as the subject 

of TW interest is called 'for, we developed this, pilot study to begin / 

looking at that area of teacher training. Because the need for the 

tra-ining <}f secondary education majors in TW is perhaps more obvious, 

we 'decided- to do thi$ pilot with elementary education majors- We-feel 

that this pilot' study might, help giye -us some 'sense of the effectiveness' 

v • ■ 

of thiVtraining for preservice^Tementary teachers who will teach in' a* 

»" > * 

variety of„<jrade and ability leveTs and in a variety of content areas/ 
f . - ' 

The purpose of this investigation was to explorfe the research 

question:* Will some training of undeVgraduate student 'te$£her&to teach 

TW strategies result in a significant 'degree of difference between the 

criterion referenced -cpntent area 'test scores of elementary children 

■ " * v • * 

•a' r 

tatight -these TW strategies and the test scores of el emaata ry children not 
taught these TW strategies? ' - . t 

Procedures , * . 

tm 4 * * 

.Just prio* 1 to their student teaching, and while completing a testing 

and measurement class, el everr elementary undergraduate majors received a 

I - v « 

module. (Flippo) containing information and learning activities in TW 
strategies f6r objective tests appropriate for* use with early childhood 
through college-leve.T students, and a seminar class conducted by one of 

r * 

4 ' 

the researchers*.' This class covered an orientation to the use of the 
module and an explanation of the procedures to be uf&d with the module, 
activities for teaching TW strategies to children, and information 
regarding the pilot s£udy. Of the eleven student teachers receiving the 
TW training, ^fgbt^of them have been inQkidecf'in this pilot 1 ; 



» •' Student teacher's were assigned to second through sixth gTaite^abil ity . 
grouped classrooms in one of^four elementary schools in northwest Mississippi 
"Students. in these schools-had been previously abi 1 ity grouped by their 
reading scores on .the California Achievement Test. In most cases, student 
teachers wfre assigned to classrooms with all high -abi 1 ity grouped children 
in a given grade in the same room or all average ability grouped children" ' 
in a given .grade .in the same room. One student teacher had a more hetero- 
geneous 'classroom assignment; however, there were not enough low atxility 
children in v that room to use low abiljty groups in this pilot' study. 

Students in the high ability and/or average ability groups in each 
class were randomly assigned at each of these ability levels into control 
and experimental groups'. A total of 174 randomly assigned students -in 
grades* 1 two through six were included in this study. Seventy-one of them 
were in experimental ; groups and one hundred and three of them were in 
control groups.. The student teachers taught a unit in one of the social 
studies disciplines to the entire -cl^s of childrea. over a period of about 1 
one month. Additionally^ experimental groups were given Tfcl irisfn/ction 
by their student teachers. The students in the control groups did not 
"receive TW strategies training but instead were involved in regularly • 
planned instructional activities within the units being studied. 

.Each day for a little over thtee fl£eks the student teachers worked 
through the 16 activities in their modules with the experimental groups 

of children. While the experimental groups worked on the TW activities 

* * * 

With the student teachers in the classrooms, the children in the control 

** 

groups worked : on other activities like art, library work, etc., related to 

" -* ' ' • 

their social studies unit with the regular classroom teachers outside the 

classrooms. During this same time period, student teachers conducted 



whole class instYu^tion-in soqial studies units. (Refer to Table 2 for the 
units taught by the student teachers.) The student teachers were cautioned 
t not to, include any fw information when teaching the'social sttidies units. 
Likewise they were cautioned not to include any material 'from the social 
studies units in the TW activities wi£h the experfmental groups. 

Each student teacher developed a criterion referenced test covering the 
social studies unit s/he taught for the purpose of measuring students* ( 
khowledge of the content taught' in .that unit. This test was developed 
according to the guidelines and instructions that the student teacher 
received in her/his testing, and measurement tlas^. It also included some 
not "so obvious TW cues. (The idea was' that the^testwise student would pick 
up on those cues and do better on the test while the student whp was not ■ 
testwfse would not do as well.) Ajll tests were submitted to the Divisiop 
of Curriculum and Instruction at .Del ta -State University and the researchers 

» 4 t • 

fo r evaluation of- val idity . r ■ : 

At the completion of the social studies units amf treatment activities, 

each entire class irf this Study'was given .the social* studies unit test 

developed by their student teacher. Only data 'from the tests which met 

a minimum quality of -measurement were* included in this study. 

' Statistical > Analysis * > . x ~ " * 

An 'initial concern was the possible existence 'of significant disparity 

in TW\^between the experimental and control groups in each classroom prior_ 

to administration of tJhe treatment. To check; for pre-treatment variance, 

the classroom teachers of these groups, were asked to rate the level of TW 

of each child in their class on a thirty point scale, -*Th'e "Te stwisffi ess 

Rating Scale" was used. (See the scale in Figure 1,-and see, Table \ for 

• . . \ 

directions for its use.) Group ratings were then compared using a Man*?-, 

Whitney Test' (Ryan, Joiner., & Ryan, 1976). . ! ' \ 

. " \ 



.Of nine .group- comparisons made from tbe, eight classrooms included in -" 
this study, none were 'significant at the .05 alpha level. Table 2 indicates' 
median- scores for the different groups and ttfCsub.sequent p. levels derived' 
from administration of .the Mann-Whitney Test. The findings indicated no ' 
Significant difference in TW. between experimental and-control .groups for * ' 
any class -prior to treatment. '. , . .*' I. 

• (Insert Table' 2 about here) 

To determine effectiveness of- the treatment, the" -unit posttest scores 

for each instructional group were, compared. /The Mann-Whitney Test was used. 

JjAle- 3 'indicates median 'scores- for the different groups and the subsequent 

P levels. The findings indicate that the TW instruction was not a significant 

' influence on .'unit posttest performance. ' • . 

Clnsert Table 3 about ftefe)* . * . 
» * * 

j Conclusions apd Recommendations * 



'Although there was not a .significant difference between the experimental 

and control treatment groups for any of .the un-its and Tor- any of the grades 

and- ability groups 4 tocjuded in "this .pilot study, there was a slightly higher 

• < . * /" 

observed score for &x of the nine experimental groups. Tffls observed, but 

insignificant,, difference certainly does not indicate that the student teachers 
/ ' " ' 

/were able to transfer the TW. strategies instruction they received to the 
students they taught. However, it does indicate that a'more tightly • 
controlled study should be done to further explore the possibilities of' TW • 
training for student teachers and its transfer to their 'future students. 

Many factors should be considered, such as the student teachers' mastejy . 
of the TW instruction they receive, the effects of several different 
approaches to the TW training of student teachers, the amount of TW training 



given to student teachers, and the 1 effects of providing TW training to 
student teachers at different times or. stages in their undergraduate • 
education preparation. ' * , ■ 

While this pilot study did give us some sense of the effectiveness 
of TW training for preservice -'elementary teachers, it suffered because of 
''the number of concomitant variables tftat were nbt controlled fpr. For ^ 
instan.ce, to what extdnt did the outside-the-classroom enrichment* activities 
(t.e., art, library worR, etc.) in the social studies units provide^ the . 
° control groups with more , knowledge of 'or interest in, the, unfts, as. compared 
to the benefits for the experimental groups receiving TW training? .Or, * ; 
to what extent did the newrieSs'or novelty -of the student .teachers teachinq ' 
the-TW effect. the- experimental, groups ' Jttentiveness? Did all of the student 
teachejs. give equal 'attention to' the TW 1 instruction of their experimental 
"groups? These *are but a 'few "of the variables that should* be controlled'.; 
before another -similar- study is attempted. We^Efiink 5ome*TW .^raining for ' 
preservipe .education students M, a good-idea;* however, more positive 
documentation will be necessary before it can be thoroughly recommended/ * * 
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* ^Reference "Notes 



The "Testwiseness Rating Scale" '-was designed for this study 
by Flippo, R., Borthwick^ P., y *nd Blanchard, J ; , .1981, 
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TESTWISENESS RATING SCALE 
Tby Flippo, Borthwick and Blanchard 



h — f — i — h 



Gfilld doesn't . 
seem .to be able 
to get the * 
answers correct, 
even when he/she 
seems to know 
the material all 
of the time, . 

• 7 



10 
-i — H 



Child seems to 
be able to get 
the answers 
correct some 
of the time, 



2b 



+— I — h- 



Child seems- to 
be able to get 
the answers 
correct most 
of .the time. 



30 



H — HH — I — r I .| 



Cfiild §eefns to 
be able 'to get 
the answers 
correct even 
when he/she 
doesn't know the 
material all of 
the time. 



Figure*! 



x \ -Table;! 

Testwiseness Rating Scale: 

Directions for Classroom Teaphers 
by Hippo and Borthwick . 



Make a copy, of your class ro11 ^ ^ 

Rate each child on your roll to show where you believe that- 
child* is in regard to his/h^r present testwiseness knowledge. 
You mus% -select a- nuftfesi ^bgtween 0 and 30. Please Tio not 

select the numbers 10, 20 or 30. * ' . 

* < 

Indicate the number selected next to each child's name on 
the roll . > v 

A£ter the children *in your class have been randomly assigned 
to control (those who will not receive testwiseness training) 
and experimental (those who will receive testwiseness training 
groups, indicate next to the number on the roll air E foi\ 
experimental and a C for control. 

If the class. 'is ability grouped, please indicate low,- middle, ' 
or high'ability group alstf next to -each child's name. If ' 
the entire class is either a low, middle, or high ability * 
group, indicate" that at the top of the roll. If the entire, 
class is a mixed ability group, please indicate that at the 
top of the roll . 



1 Pre-Treatment. Ratings on Testwisertess 



Group Comparison " 1 Medlan * p 
^ t . L.! ' Exp erimental Control 



Second Grade-High" Ability, 

Transportation Unit * 
Second Grade- Average Ability 

Transportation Unit * 
Third Grader-High Ability. - 

Mississippi Unit-'' 
Third OA^e-High. Ability 

Differences Are OK. Unit 
Third Grade-Higtt J^biiity 

US Postal Service Unit 
hoarth Grade-High Ability 
~ Regions of the US Unit 
Fourth Grade-Average Ability. 

• •Japan Unit 
Fifth Grade-High Ability 
" Tooth Care Unit. 
Sixth Grade-High Ability 

Mexico Unit 



26.00 


28.0O ; 


.0814 (NS) 


OA Zf\ 
. JU 


23.00 


» 

f 

.£985 (NS) 


21.50 


21-. 00 


* 

.8918 (NS) 


23.00 


"25.00 


.2934 (NS) 


21.00 


J 21.00 


.6261- (NS) 


22.00 


21.00 


• .2 727 (NS) 


27.00 


27.00 


.9.6U (NS) 


23.50 


21.00 


".5669 (NS) 


21.50 


24.00 


.0793 (NS) 



Table 3 'J ' * . 
. Comparison of Unit Posttest Scores by Group 



Second Grade-High Ability 

Transportation Unit 
Second Grade-Average Ability 

Transportation Unit 
'Third Grade-High Ability': 

Mississippi Unit- 
Third Grade-High Ability 

Differences Are OK, Unit 
Third Grade-High Ability 

US Postal Servft^'Unit 
Fourth Grade^High Ability 

vKegioris of the US Unit. 
Fourth Grada-Average Ability 

Japan Unit 
Fifth Grande-High Ability 

Tooth ^Ca,re Unit 
Sixth Cjade-High Ability 4 

Mexico Unit 



Group Comparison . ^ Median <^ ' : i T 

neaian ^* ^ p i eve i 



Experimental Control 



100.00 


100.00 


1.000 


(NS) 


97.50 


92.50 


-.6985 


(NS) 


94.00 


82.00 


• 

• *1 \J *. J 


) 


82.00 


79.00 


.8182 


(NS) 


94 . 00 


93.00 


.8983 


(NS) 


99.00 


98.50 


.8625 


(NS) 


100.00 


100,00 


1 .000 


(NS) 


89.00 


85.00 


, -1921 


(NS) 


85.50 


88.50 


. -5934 


(NS) 



